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ABSTRACT 

In order to test the internal evaluative processes 
and not merely the final reactions of an audience to a speaker, 97 
Caucasian college students expressed their attitudes toward Malcolm X 
while listening to a 25-minute tape-recorded speech by him. Eight 
30-second silent intervals at natural pauses in the speech gave the 
students time to respond during the stimulus speech. The subjects 
completed semantic-differential pre- and post-tests on Malcolm X. Two 
control groups responded only to the pre- and post-tests— group A 
without hearing the speech, group B hearing it uninterrupted. Eight 
scaled evaluative sets were used to determine attitude toward the 
speaker (i.e. , reputable, kind, educated, selfish). Although 
post-test results for the experimental group and control group B were 
remarkably similar (thus negating the possibility of experimental 
disruptive effects) , results obtained from the experimental group 
during the speech's eight intervals revealed significant shifts in 
the group's attitude toward the speaker. Informed statements can be 
made about when changes occurred, at what rate, and in relationship 
to what speech content. It was concluded that this process analysis 
of communication presents a fuller, truer description of audience 
reactions than the traditional static methods of evaluation* (MF) 
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SPEECH AS PROCESS: A CASE STUDY 
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HE best contemporary models of 

communication attempt to portray 

I O on-going interaction and change oc- 
t ^^curring over time. These models assume 
L v ■ / hat when speaker addresses listener he 
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participates in a host of developing and 
everchanging relationships with his au- 
dience, his message, and his environment. 
He does not engage in a discrete event 
but in a dynamic process that has no 
clear beginning, no distinct finale. The 
process approach is as old as Heraclitus’ 
„ * view of flux (“We are and we are not”) 
and as current as contemporary philoso- 
phy of science. It is a basic way of seeing 
the universe. 

While most theoretical writings em- 
phasize the dynamic nature of communi- 
cation, in practice the bulk of research 
On influence through speech imposes a 
static view. The concentration is on in- 
vestigating the outcome of the process 
rather than on the process itself. The 
studies frequently involve comparing 
scores on an attitude scale administered 
■ prior to . a speech with, scores obtained 
." following the speech. There has been 
much discussion ; of the traditional 
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W other designs have been suggested 
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Each design, however, be it pretest- 
posttest or posttest only or four-group 
design or offset, before-after design, 
yields as basic data for inferences about 
effects a pretest and/or posttest measure- 
ment. Our concern is not to compare 
these designs but to question the ade- 
quacy of only one or two measurements 
for assessing speech effects. 

Viewing speech as process and wishing 
to gain maximum information from 
which to make inferences about speech 
effects, we are concerned with how many 
measurements should be made and 
when they should be made. At what 
point in the speech process does influ- 
ence occur? Does it occur gradually over 
time or in a few sudden steps? Does it 
develop in a linear monotonic pattern, 
or is the function more complex? Might 
there be influences which occur between 
pretest and posttest but apart from the 
stimulus message? Answers to these 
questions are untapped in most studies 
following traditional patterns. The on- 
going process — the basic character of 
communication — is usually slighted in 
favor of a finding determined after a 
speech, although the effects presumably 
occurred during the speech. Yet proce- 
dures for analysis of process are readily 
available . 2 Below we present a study 
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jyjtjich _we think reveals the practicality ^ white, college audience by Malcolm. Lit- 
and advantages of a process approach, to - -tie (Malcolm X), the late spokesman for 
one question about communication and * the Black Muslims. 5 He spoke in sup- 
which yields findings of considerable —port of the proposition that American 
significance. .Negroes should separate from white 

The present study sought to investi- society. The tape recording was edited 
gate an important speech phenomenon: by splicing seven silent periods into the 

changes in an audience's evaluative re- speech and attaching an eighth silent 
sponses to a speaker during his speech, period immediately after Malcolm’s 
Most studies of audience's attitudes to- closing words. Each silent period had a 
ward speakers (ethos) have used pretest- duration of thirty-seconds. Each was 
posttest designs. 3 Only a few of those positioned at what seemed a “natural” 
surveyed by Andersen and Clevenger division of the speech: the first silent 
made explicit the view that an auditor’s period came at thirty seconds into the 
evaluation of a speaker changes during address, following a brief introductory 
the communication. 4 Even these studies prayer by the speaker; the remaining 
followed the usual paradigm and did silent periods were spaced at intervals 
not measure audience response during from three and one-half to five minutes 
the communication. Our desire to ex- apart, with an average interval of four 
amine one aspect of ethos — evaluative minutes, usually at the conclusions of 
responses toward the speaker — as a de- the main themes of the speech. Our 
veloping, on-going process, prompted major concern in positioning the silent 
these interrelated questions: periods was to avoid disturbing the con- 

1 ) Do evaluative responses toward a tinuity of the speech while approxi- 

speaker vary during a speech? mating equal spacing. The silent periods 

2) If such variations occur, do they oc- provided eight intervals during which 

cur in a linear pattern or do they occur evaluative responses toward the speaker 
in some other function? were measured. 

- 3) How do findings generated by this Measurements. Semantic-differential, 
technique compare with more tradi- evaluative scales were used in the pre- 
tional methods of assessing speech test, the eight intervals, and the posttest 
effects? measurements. Each administration con- 

sisted of a set of three scales with high 
Procedure factor loadings on the evaluative dimen- 

" Stimulus speech. The stimulus speech sion and two “filler” or “masking” 
for this study was a tape-recorded 25- scales. 6 The attitude concept measured; 
minute address to a predominantly was “Malcolm X.” Tire order of the sets 

of scales for the eight interval measure- 
ments 7 was randomized so that each set 
1 
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of three evaluative scales appeared in 
each silent period approximately an 
equal number of times. To be sure, 
some difficulties arise from using eight 
different sets of evaluative scales. We 
judged, however, that the difficulties 
would be fewer than those which might 
result from eight repeated measurements 
with a single set of scales. The mean of 
each set was determined and the eight 
sets were adjusted to a common mean 
to correct for inherent inflation or de- 
flation effects within a set. 8 

Subjects. Numerous studies of audi- 
ences' attitudes have dramatized the ef- 
fects upon audience responses of organ- 
ismic variables such as prior attitude, 
intelligence, ancTsex. In order to control 
any influence of these variables upon 
our major results, these variables were 
included as elements of the design. The 
ninety-seven subjects who took part in 
this study were grouped according to 
higher and lower intelligence based 
upon college entrance tests and higher 
and lower initial attitude toward the 
speaker based upon the pretest attitude 
scale, by dividing the group at the 
median on the relevant distribution: 
The subjects were further grouped ac- 
cording to sex. From this division, it 
was possible to assign five subjects to 
each cell (n = 40) in a 2x2x2 repeated- 
measurements design with prior atti- 
tude, intelligence, and sex serving as in- 
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dependent variables and evaluative re- 
sponses toward the speaker, observed at 
the eight 'intervals, serving as the de- 
pendent variable. All. subjects were 
Caucasian undergraduate students in 
introductory public speaking classes. 

The subjects completed a semantic- 
differential pretest on Malcolm X (with 
masking items) three days prior to hear- 
ing the stimulus speech. During the 
class period devoted to the study, the 
subjects heard the stimulus speech and 
completed the speaker evaluations dur- 
ing the eight intervals. At the conclusion 
of that period, the subjects completed 
an additional semantic-differential post- 
test for Malcolm X. 

Control groups. Because of the ques- 
tions of this study and because of the 
repeated-measurements process analysis, 
two control groups were employed. Con- 
trol group A (n = 14) served as the 
standard control against which to assess 
pretest-posttest changes in attitude by 
subjects. Control A was given the pretest 
and posttest but did not hear the 
speech. This group controlled for 
changes which could be attributed to 
factors other than the conditions of the 
study. . 

As Becker has observed, some critics 
claim that interruptions, such as the in- 
terval tests used in this study, “. . . dis- 
. tract the. respondent from the message 
and' thus make his response abnormal." 9 
In order to examine that possibility 
Control B (n = 20) was established. This 
group was given the pretest, listened to 
an unedited version of the speech that 
did not contain the eight silent periods, 
gave no interval responses, and was 
giveii the posttest. This group controlled 
for possible disruptive effects of the* re- 
peated measurements. 
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Results represents the internal-intervals measure- 

Figure 1 presents a summary profile ments for the experimental group. Pre- 
of the experimental and control groups’ and posttest means are given for the ex- 
evaluative responses toward the speaker, perimental group and the two control 
All data are reported in terms of the groups. The shifts in evaluative responses 
mean item score for the three seven-point for the control groups are illustrated by 
semantic-differential scales used for each the dotted-line graphs. Relevant t tests 
measurement. The dashed-line graph are appended to Figure 1. 
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FIGURE.! 

Evaluative Responses Toward Speaker Over Time Intervals 
Time Time Time Time Time Time Time 
Pre- i s 3 4 5 6 7 

test 4.54 4.34 4.06 4.30 4-39 4<>7 4°2 



Time 

8 

3-93 



Post- 

test 



I \ 

1 

I 






\ ✓ 
V 






.b 

• 



I 

i 



i 

i 

t 

r' 

e.| 



..••4 



• 



•• • 



1.0 

Group 

Experimental (e) 

• Control A (a) 

Control B (b) 

•Significant at the 1 percent level 
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The following conclusions may be 
drawn from the analysis of the data: 

1) The differences between the means 
of the experimental and two control 
groups on the pretest are minimal and 
statistically nonsignificant. It can be as- 
sumed that the groups did not differ ini- 
tially in evaluation of the speaker. 

2) The pretest-to-posttest change in 
^ evaluative response toward the speaker 
) was slight and statistically nonsignificant 

for Control A, the group which did not 
• hear the speech. The changes for the Ex- 
j perimental group and Control B, the 
| group which heard the uninterrupted 
» speech, showed significant increases in 
| evaluation of the speaker. The remark- 
j able similarity “between the pre- and 
[ posttest means for the Experimental 
group and Control B gives some indi- 
1 1 cation that the process-analysis technique 
j ; was not so disruptive that it influenced 
subjects* responses. 

3) The controlled organismic variables 
! were not found to be related to evalua- 
tions of the speaker over time. The 
2X2X2 repeated-measurements analysis 

I of variance revealed no significant main 

| effect or interaction involving the or- 

! ; ganismic variables. This finding allows 

for wider generalizing from the follow- 
i ing results. 

I I 4) The trend analysis of Times indi- 

I cated significant changes in evaluation 

[ of the speaker over time (F = 2.32, with 

| d.f. of 7 and 224, p < .05). A test of the 

| nature of the trend revealed a significant 

i linear trend in the interval measure- 

ments (F = g.go, with d.f. of 1 and. 224, 
I p < -oi). These results, aided by in? 

1 spection of the graph and the significant 

| difference between the means at Time 1 

I and Time 8 (t — 2.g2, p < .01), lead . to 

I the conclusion that the best description 

I of evaluation of the speaker during the 

|. speech process would be that it was a 

i \ decreasing evaluation varying only 

\ slightly from a linear scale. v 
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Conclusions and Discussion 

The results of this study lead to sev- 
eral conclusions which we think could 
well influence the design of future stud- 
ies and interpretation of past inquiries 
into aspects of attitude change. 

First, process analysis by internal 
measurements appears to be a practical 
method of inquiry. The close proximity 
of the posttest scores for the Experimen- 
tal and Control B groups indicate little 
disruptive effect. It should also be said 
that during the stimulus situation no 
subject was observed to be overtly dis- 
tressed or annoyed by the interruptions. 
Moreover, after all data were collected, 
one of the writers returned to the classes 
to answer questions and discuss the study 
with the participants; none voiced dis- 
pleasure with the measuring technique 
employed. It appears that while such in- 
terruptions are exceptional, they need 
not generate abnormal responses. 

If the internal measurements pro- 
duced testing effects not measured or 
observed during this study, however, fu- 
ture investigations could probably min- 
imize such effects by incorporating one 
of the following modifications. The si- 
lent intervals could be shortened; thirty- 
seconds appeared to be more than ade- 
quate in the present study. The number 
of intervals of the number of scales used 
in each interval could be decreased. By 
V decreasing the number of intervals, of 
course, one runs the risk of obscuring 
certain effects within the communication. 
Ideally, one might employ continuous 
paper and pencil or electronic measure- 
ments that would do away with formal 
interruptions entirely. Further research 
would be necessary to assess the efficacy 
of any of these modifications. We *do 
not assume they are necessary; they are 
. mentioned solely to suggest alternative 
. procedures . for examining on-going 
speech processes. 
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In addition to their practicality, proc- 
ess-analysis methods provide a richer de- 
scription and more confident assessment 
of communication effects. Internal meas- 
urements aid the researcher in locating 
communication elements that appear to 
induce attitude change. For example, in 
the present study an increase in favor- 
able .evaluations toward Malcolm X was 
observed at Time 4. The speaker had 
just argued that the Black Muslim move : 
ment had restored pride to the Negro 
race and diminished hate the Negroes 
allegedly bear toward their blackness. In 
the interval preceding Time 6, Malcolm 
‘X had argued thus: A Negro who wants 
..integration thinks . . that he should 
have your house; he thinks he should 
[have your factory; he thinks that he 
should have your school; and most of 
them think that they should have your 
. Woman, and most of them are after your 
•woman .** The measurement (Time 6) 
revealed a negative shift in evaluation 
in contrast to the relatively favorable 
measurements achieved at Time 4 and 
Time 5. The measurements did not in- 
crease in favorableness after Time 6: 
Times 7, 8, and posttest revealed de- 
creasing. evaluations. The content fol- 
lowing Time . 5 and preceding Time 6, 
then, may well provide the most signifi- 
.cant data about the speech. In any event, 
the internal measurements were useful 
items in both describing and assessing the 
decline in favorable evaluations observed 
in the speech. One now knows not 
merely that Malcolm's ethos diminished 
during this speech; we can make in- 
.. formed statements about when and at 
what rate and in relationship to which 
speech contents. 

. The importance of process analysis, it 
seems to us, is dramatized by a compari- 
son of the Experimental with Control 
B data. An analysis of the data from one 
of these groups in isolation from the 
other group would produce diametrically 



opposed findings. The data for Control 
B, collected in the traditional pretest- 
posttest pattern, would be interpreted as 
indicating Malcolm's ethos increased 
favorably during the speech. Pretest and 
posttest data alone from the experimen- 
tal group would warrant a similar con- 
clusion, an increase in ethos. But inspec- 
tion of the graph for changes over time 
(Figure 1) and the test of trend argue 
more fully that Malcolm's ethos declined 
during the speech. The increase reflected 
in the Control B findings apparently was 
generated sometime between the pretest 
and the first interval measurement. Time 
1, which followed the opening words. A 
process analysis allows us to locate the 
time period in which the shift occurred. 
In the present study this advantage 
proved to be crucial in interpreting the 
results. Had we followed the traditional 
pattern and relied only on pretest to 
posttest differences, our description of 
the speaker’s effects would have at best 
been inadequate if not absolutely in- 
accurate. 

How can one account for the remark- 
able shift between the pretest and the 
first measurement? One is tempted to 
turn to the content which preceded 
Time 1, a short prayer of thanks to Al- 
lah for sending Elijah Muhammad to 
help American Negroes. However, the 
prayer was delivered rather rapidly and, 
it seemed to us, perfunctorily. It hardly 
seemed potent enough to spark signifi- 
cant changes in an audience composed of 
white non-believers whose pretest atti- 
tudes toward the speaker and his move- 
ment were negative. Our view at the mo- 
ment is that the mere presence (or, via 
tape recording, the “quasi-presence”) of 
a speaker generates early shifts in atti- 
tudes toward him, especially in the pres- 
ence of audiences who have had little 
or no direct prior contact with the speak- 
er. In such cases pretest attitudes might 
be very unstable as they are not based 
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on any actual experience with the object 
of the attitude. When the unfamiliar 
“enemy” appears before us in person, or 
through the medium of his voice, it may 
be our tendency to endow him with an 
unsuspected humanness and to conclude 
that he cannot be as bad as his reputa- 
tion. Conversely, perhaps when the un- 
familiar “hero” presents himself, we find 
that he is all too human. That is another 
question . 10 

If the early shift in attitude noted 
here is a general phenomenon, it cer- 
tainly should shape our interpretation of 
•past studies which have followed the 
traditional pretest-posttest designs . 11 It 
might well indicate that the significant 
shifts assumed to have occurred between 
pretest and posttest transpired very early 
in the speech, or perhaps in the experi- 
mental setting prior even to the first 
words of the speech , 12 and that the shifts 




during the balance of the speech were 
minimal or in an opposing direction. In 
other words, studies which report a fa- 
vorable or negative shift on the basis of 
pretest and posttest differences may well 
have overlooked a significant shift in 
the opposite direction by taking the 
wrong starting points. Specifically, we 
suggest that pretest measurements are 
more meaningful if taken in the pres- 
ence or simulated presence of the speak- 
er. In many experimental situations 
this may mean “pretesting” after the 
speaker or his recorded voice or image 
has begun. 

In summary, we find analysis of a 
communication through time a practical 
method of inquiry and a method con- 
sonant with the view that communica- 
tion is a process. Further, the method 
employed here provided a fuller and, 
we think, truer description of audience 
response during speech. We believe this 
method may. be an important improve- 
ment over traditional procedures. Last, 
one of our findings — the early shift ef- 
fect — may have profound implications 
for interpretation of past research and 
for design of future studies. 
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See for example: Donald Campbell, "Factors Relevant to 
the Validity of Experiments in Social Settings," 
Psychological Bulletin , LIV (July 1950), 297-312; Samuel 
Stouffer, "Some Observations on Study Design," American 
Journal of Sociology , LV (January 1950), 355-361; Richard 
Solomon, "An Extension of Control Group Design," 
Psychological Bulletin XLVI (March 1949), 137-150; Donald 
Campbell and Julian Stanley, "Experimental and Quasi-Ex- 
perimental Designs for Research in Teaching," in N. L. 

Gage, ed. , Handbook of Research on Teaching (Skokie, 111., 
1963), Chapter 5; William Brooks, "Effects of a Persuasive 
Message upon Attitudes: A Methodological Comparison for an 
Offset Before-After Design with a Pretest-Posttest Design," 
The Jou rnal of Communication, XVI (September 1966). 

180-188. 



For reviews of selected procedures applicable to process 
analysis see Samuel Becker, "Methodological Analysis in 
Communication Research , " Quarterly Journal of Speech , LI 
(December 1965), 382-391, especially page 388, and Samuel 
Becker, "Reaction Profill: Studies of Methodology," — 
Journal of Broadcasting . IV (Summer 1960), 253-268, 
especially pages 254-255. 

3 

Many studies of ethos measure attitudes toward proposi- 
tions attributed to favorable, unfavorable, or neutral 
sources rather than toward the source iteself. But here, 
too, the indirect measurements of ethos are drawn from 
the standard pretest-posttest or after-only designs. See 
Kenneth Andersen and Theodore Clevenger, Jr., "A S umma ry 
of Experimental Research in Ethos," SM, XXX (June 1963), 
59-78. 

4 

Andersen, and Clevenger, p. 68. 

^The data for this study were collected at San Diego State 
College, prior to Malcolm’s ouster from the Black Muslims 
and before his assassination. The speech originally was 
given before students at Cornell University in March 1962. 
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The scales were selected from Charles Osgood, 

George Suci, and Percy Tannenbaum, The Measurement 
of Meaning (Urbana, 1957), Chapter 2. 

^The eight evaluative sets were: high-low, wise- 
foolist, and honest-dishonest; influential- 
uninfluential, intelligent-unintelligent, and true- 
false; successful-unsuccessful, superior-inferior, 
and beneficial-harmful; positive-negative, right- 
wrong, and unselfish-selfish; reputable-disreputable, 
useful-useless, and educat ed- ignorant ; good-bad, 
important-unimportant, and rising-falling; 
optimistic-pessimistic, complete-incomplete, and 
meaningful-meaningless; kind-cruel, perfect-imper- 
fect, and fortunate-unfortunate. During the 
administration, the positive and negative poles of 
the scales were positioned at random. 

g 

Our procedure here followed the pattern discussed 
in the section on "Problems in Rating-scale Con- 
struction and Use," in J. P. Guilford, Psychometric 
Methods , second ed. (New York, 1954), pp. 278-294. 

9 

Becker, "Methodological Analysis . . . , " p. 388. 

TO 

Compare the discussion of assimilation and contrast 
effects in David Krech, Richard Crutchfield, and 
Egerton Ballachey, Individual in Society (New York, 
1962), pp. 31-32. 

11 

In research in progress we have found confirmation 
of the generality of this effect with speakers toward 
whom audiences held negative pretest attitudes. We 
hope soon to investigate this with speakers who elicit 
favorable pretest scores. 

12 

See, for example, William McGuire and Susan Millman, 
"Anticipatory Belief Lowering Following Forewarning of 
a Persuasive Attack," Journal of Personality and Social 
Psychology , II (October 1965), 471-479; James McCroskey 
and Robert Dunham, "Ethos: A Confounding Element in 
Communication Research," SM, XXXIII (November, 1966) , 
456-463. 



